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This study analyzes publicly available literature and documentation on 
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I. 


PREFACE 


The Japan Maritime Self Defense Force (JMSDF) i will initiate its first 
performance-based logistics (PEL) contract in fiscal year 2010. This first contract is an 
experiment in contracting with private firms to provide direct support for military forces. 
Performance-based logistics is a very new concept for the Japan Self Defense Force, and 
many policy issues remain unaddressed. The purpose of this Master’s project is to 
explore the critical strategic and operational risks and benefits that the JMSDF should 
consider concerning outsourcing public functions. 

A. INTRODUCTION 

Many domestic laws, regulations and rules affect PEL in Japan. It is difficult for 
the Japan Ministry of Defense (MoD) to change national laws, because those laws cover 
entire ministries and offices. Although some laws contain exceptions for the military— 
such as the Civil Aeronautics Law, the Law for Controlling the Possession of Firearms or 
Swords and Other Such Weapons, and the Fire and Disaster Management Law— 
acquisition- and contract-related laws have no exceptions for the military. National laws 
should be thought of as immutable regulations governing the establishment, funding and 
management of PEL contracts. On the other hand, regulations and rules created by the 
MoD can be amended, and we may assume that such regulations and rules will be 
changed so that PEL contracts may be used. In this project, we will treat national laws as 
constraints on PEL contract design, implementation and management, while rules and 
regulations established by the MoD will be considered flexible with respect to 
implementing PEL. 

B. BACKGROUND 

A general understanding of the laws, regulations and rules that apply to military 
contracts in general, and performance-based contracts in particular, is necessary at the 
outset of any discussion of public contracting. We will first discuss how a PEL contract 

^ JMSDF: Japan Maritime Self Defense Force (JMSDF) is the national naval military service of Japan. 


1 



works and some of the legal issues surrounding such a contract, and then discuss why the 
JMSDF wants to implement such contracts. Finally, we will introduce the supply and 
contract organizations in the JMSDF, and discuss their role in creating and governing 
such contracts. 

1. Definition of Performance-Based Logistics (PBL) 

A PBL contract is an outcome-based performance approach to contracting for 
logistics support of weapon systems that has become increasingly popular within the 
defense sector of both the United Kingdom and United States. Traditionally, both the 
public and private sectors have established contracts for specific equipment, parts, and 
labor and then managed these inputs to achieve a specific management target. 
Performance-based logistics contracts differ from this approach, in that they purchase a 
performance outcome such as an availability rate, an on-time delivery or fill rate, or a 
reliability rate such as mean time between failure (MTBF) or mean flight hours between 
unscheduled removals (MFHBUR), based upon an assumed or forecasted operating 
tempo and set of operating conditions. The theory behind the performance-based logistics 
contract is that by purchasing an outcome both customers and suppliers share risk. For 
example, in a traditional contracting arrangement, customers might contract for the 
purchase of spare parts and keep inventory so that they have enough on-hand to achieve a 
stated performance goal and achieve their missions. However, in a PBL contract, the 
supplier provides an outcome and therefore takes on a portion of the risk associated with 
the contract in the form of inventory, which they would ideally own.^ 

Performance-based logistics is about not only risk sharing, but also cost reduction 
and higher performance. One of the biggest reasons why the JMSDF wants to implement 
PBL is to reduce cost. Although there is a popular claim that PBL contracts compress 
costs, evidence to the contrary exists. For example, the General Accounting Office 
(GAO) points out that the evidence of cost reductions by PBL contracts within the 
Department of Defense (DoD) is not clear (GAO, 2008). With respect to performance, 
many analyses show how PBL improves outcomes. For example, the U.S. Department of 


^ If the supplier does not own the inventory, then the incentive to improve reliability is reduced. 
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Defense Inspector General found improvements in availability, reliability, training 
opportunity, and Navy depot workload and product for the SH-60 helicopter (DoD 
Inspector General, 2006). 3 However, the public literature contains no conclusive 
evidence that demonstrates an increase in performance coincident with a reduction in 
costs. In other words, some studies and documents claim reductions in cost and others 
claim improvements in performance but little evidence supports a cost for performance 
measure that conclusively demonstrates an improvement in performance while reducing 
costs. 


2. Mechanism of PBL 

The key features of a PBL contract are cost reduction and performance 
improvement, which are achieved through a carefully selected set of performance targets 
and metrics, mechanisms to measure performance, and appropriate incentives or 
disincentives associated with each performance target. Normally, higher cost and higher 
performance are positively correlated; in other words, the more you pay, the better 
performance you have, but the less you pay, the worse performance you have. However, 
the idea behind PBL is that you may achieve both cost reduction and performance 
improvement; the contract customers control the incentives of their suppliers while 
enjoying the seemingly contradictory benefits of performance improvement. 

There are many means of providing incentives to suppliers; one of the most 
popular is performance-based compensation. Under performance-based compensation, 
suppliers receive a bonus if they achieve a performance target. Another incentive is the 
long-term contract. Most contracts have a period of performance of less than one year 
(especially if the government is the customer) because, with some exceptions, the fiscal 
year is one year. As an example of one exception, DoD PBL contracts for H-60 
helicopters have terms ranging from 31 months to 10 years (Inspector General, 2006). 


3 This report also stated that the selection of performance factors and measurement should be 
considered with more care. 
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Supplier disincentives in the contract may include a penalty (in the form of a fee or 
reduced customer payment) associated with a supplier’s failure to meet a performance 
target. 


3. PBL Implementation in JMSDF 

a. Motivation for the Implementation of PBL in the JMSDF 

Because of the recession, and the demands of taxpayers, the MoD plans to 
cut 15% of its acquisition costs through 2011. The JMSDF will try to achieve a 15% 
reduction in costs without having to reduce rates of operation and equipment utilization. 
The United States and Great Britain have been using the PBL concept, particularly for 
aviation assets, for several years. Aware of some of the success stories coming out of 
Great Britain and the U.S., the MoD established the “MoD Total Acquisition Reform 
Plan” in March 2008, which created laws and rules governing PBL for those contracts 
implemented after 2009. Shortly afterward, the Internal Bureau in MoD^ decided to fund 
a “Study to Reduce Cost for Equipment” in 2011 to investigate the present condition of 
equipment, as well as its logistics support strategy, and identify how other countries are 
reducing their costs (to include the use of PBL) and apply those methods where it is 
feasible. The JMSDF will begin its PBL pilot model in 2010 and implement a “Study of 
Optimum Maintenance for Logistics Systems” in 2011. 

b. PBL Pilot Model 

The JMSDF is planning to implement its PBF pilot model by applying a 
performance-based contract to the management of about ten repair parts for the MCH- 
101 helicopter.5 In this PBF pilot model, the JMSDF plans to achieve a certain inventory 


^ Internal Bureau in MoD is the organization that supports the Minister of Defense. Most of the 
members of Internal Bureau in MoD are civilian workers. 

5 The MCH-101 is a minesweeping, transportation, and anti-submarine patrol helicopter that is 
designed by EH Industries and produced by Agusta Westland in the United Kingdom. This helicopter is 
operated by five countries including Japan. Agusta Westland has a PBL contract with the Royal Navy and 
Royal Air Force as well as other nations (Agusta Westland, 2009). 
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level for the designated repair parts and have the contractor maintain that inventory; if 
inventory falls below the desired amount then the contractor will refill inventory within a 
specified time. 



Figure 1. MCH-101 helicopter (From: Kawasaki Aerospace Company, 2010) 


The JMSDF chose the MCH-101 for a PEL pilot model based upon the 
following criteria: 

• the rate of operation of the MCH-101 is very low 

• the lead time of some parts is very long^ 

• the proposed PEL contractor, Agusta Westland, produces the MCH-101 
and has experience with the weapon system, and 

• the PEL contract stakeholders are limited, because there are just two main 
suppliers, so it is easier for JMSDF to structure its organization around the 
PEL contract 

The budget for the PEL pilot model has already been approved by the 
Diet. During the PEL pilot, the JMSDF has established several conditions: 


^ For example, the lead times of some parts are 20 months. 
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• the JMSDF will not provide performance-based compensation because it 
is difficult for the JMSDF to offer bonuses under current laws^ 

• suppliers will have a long-term contract as an incentive^ 

• should the number of aircraft increase, the JMSDF will offer repairable 
spare parts to the suppliers, and 

• suppliers will provide all necessary data to evaluate their performance to 
the JMSDF, and the JMSDF will evaluate the pilot model using a third 
party 

The JMSDF is conducting a cost-benefit analysis and contracting for the 
PEL pilot model using a third party contractor. 

c. PBL Implementation Plan 

The JMSDF plans to use its experience and lessons learned from the MCH- 
101 and expand the PBL concept to other equipment should the pilot be successful. 
Currently, the JMSDF imagines using PBL contracts for the entire maintenance level of 
training aircraft, and for higher levels of maintenance (i.e., above shop level)^ of operating 
aircraft. 

Figure 2 shows the PBL implementation plan provided by the Maritime 
Materiel Command (MMC). According to this information, while the JMSDF will continue 
the PBL pilot model until 2014, they will apply results of the MCH-101 pilot to the Study of 
Optimum Maintenance Logistics Systems in 2011. The Study of Optimum Maintenance 
Logistics Systems seeks to find the optimum maintenance and logistics practices (to include 
contracting maintenance out to private contractors) for all weapon systems and then 
coordinate contracts in 2012 for the P-1,TH-lSS^i and other platforms from 2013. 


^ On the other hand, JMSDF will not establish a special penalty for failure to meet a performance 
target but instead claim a standard, normal penalty, which is 0.05 percent of the contract price per day if 
companies do not meet the established performance criteria. 

^ The long-term contract is desirable for the contractor because it allows them to make business 
expansion and long-term capital investment plans, as well as lock in contracts with their suppliers. 

^ Shop level maintenance is a kind of Inspection-level maintenance. In shop level maintenance, some 
assemblies or components are dismantled and inspected. 

The P-1 is a patrol aircraft of JMSDF, which is designed to replace P-3C patrol aircraft. The P-1 is 
manufactured by Kawasaki Heavy Industry and now it is under development. 

The TH-135 is an imported training helicopter of JMSDF. The TH-135 is manufactured by 
Eurocopter. 
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Figure 2. PEL Implementation Plan (From: MMC, 2009) 


4. Key Laws Affecting PEL Use 

The key laws affecting PEL for the JMSDF are the Public Accounting Law, 
Public-Finance Law and State-Owned Articles Management Law. These laws never 
anticipated PEL contracts or the outsourcing of public functions to the private sector and, 
therefore, any implementation of an outsourcing contract such as PEL will likely run 
afoul of one or more of these laws. In 2010, the MoD will conduct a study to determine 
the impact of these laws on PEL and PEL implementation and then determine whether 
PEL may be implemented under the current laws or whether the laws need to be amended 
to accommodate PEL. 


a. Public-Finance Law 

The Public-Finance Law was enacted on March 31, 1947. This national 
law is the fundamental law governing public finance in Japan and establishes the types of 
budget, budget compilation and execution of payments permissible by public institutions. 
According to article 14-2, the government can execute budget expenditure over 
continuing fiscal years if the contract(s) requires more than one year to complete. In 
article 14-3, the law mentions that the Diet can extend the execution to more than 5 years, 
though normally there is a 5-year maximum. The theory behind PEL is that, with long¬ 
term contracts, suppliers will be motivated to improve quality and lower their operating 
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costs, capturing the difference between the contract price and their reduced costs in the 
form of additional profit. However, until now, continuing expenditures beyond 1 year are 
used only for the construction of ships and submarines, so it is difficult to apply to PBL 
contracts. On the other hand, according to article 15, the government can use bond- 
related expenditures (with approval from the Diet) for long-term contracts, but there is no 
precedent within the MoD for such an action. 

b. Public Accounting Law 

The Public Accounting Law was enacted on March 31, 1947. This 
national law states the procedures related to revenue, expenditure and contracts. 
According to article 9-11, the contract officer has to verify the completion of a contract; 
however, there is no contract officer who has the experience to verify performance, and 
indeed the JMSDF as a whole does not know how to evaluate performance. According to 
article 29-6, contract officers must decide how to establish a target price to select 
contractors, but current guidance is insufficient for contract officers to establish an 
appropriate price for performance. 

c. State-Owned Articles Management Law 

The State-Owned Articles Management Law was enacted on May 22, 
1956. This national law states the procedures to manage national assets. According to 
article 7, the Minister of Defense must manage MoD’s property in-house, so he cannot 
outsource the management of parts or assemblies to the commercial companies. In the 
PBL pilot model, the JMSDF provides each part to the company, so it can clear this law; 
in the future, however, this law will become a big barrier against PBL contracts. 

5. JMSDF Knowledge of PBL 

The JMSDF’s PBL knowledge is currently insufficient. Though there are many 
articles related to PBL in English, however these articles are invisible to anyone 
conducting a search in Japanese; furthermore, most Japanese cannot read well in English, 
so it is very difficult for Japanese military people to study about PBE by themselves. As a 
result, the JMSDE cannot help relying on third parties or private defense contractors. 
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The use of third-party private defense contractors offers the JMSDF a lot of 
beneficial information as a result of their long relationship and because they are experts 
in their weapon systems. However, the use of third parties presents some complications 
as well as it may be difficult for them to understand and fully integrate with all of the 
JMSDF’s unique systems, processes and legal requirements. Moreover, some third 
parties are not reliable. For example, a 2006 Nimrod crash in Afghanistan was attributed 
by some experts to a lazy third party contractor that did not supervise the maintenance 
properly and the customer was completely reliant on that third party for all maintenance 
expertise (Chuter, 2009). Further, the private firm’s fundamental goal and mission is to 
earn money whereas the fundamental goal and mission of the JMSDF is to defend the 
lives and property of the citizens of Japan and therefore there is a basic, structural conflict 
of interest between the two and the potential for bias that would favor the firm and 
compromise the JMSDF is real. In fact, the information presented by private defense 
contractors makes little mention of cost reduction, performance improvement or the 
potential risks associated with performance-based contracting (Saito, 2009; Eurocopter 
Japan, 2009). 


6. Supply and Contract Flow of JMSDF 

Figure 2 shows the supply and contract flow in the JMSDF. The Minister of 
Defense decides upon the overall goal, upon which the Chief of Staff, JMSDF, makes the 
general plan. The Maritime Material Command (MMC) procures, keeps and maintains 
materials that are used by the JMSDF and also conducts logistics research. The Ship 
Supply Depot (SSD) and Air Supply Depot (ASD) are managed by MMC. SSD performs 
acquisition, storage, supply and maintenance for ships while ASD performs the same 
activities for aircraft. Most contracts are made by SSD and ASD, and goods and services 
are sent from private defense contractors to squadrons via SSD or ASD. Ships and 
aircraft themselves are not procured through MMC, SSD or ASD but are acquired by the 
Equipment Procurement and Construction Office. 
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Figure 3. Supply and Contract Flow of JMSDF 


C. PROBLEM STATEMENT 

It is currently difficult for the JMSDF to gain objective information or knowledge 
about PBL, which means that they cannot objectively assess costs, appropriately measure 
performance, or mitigate the potential risks when considering the implementation of a 
PBL contract. 

D. PURPOSE OF THE PROJECT 

The purpose of this project is to identify aspects of the experiences of the United 
States with performance-based logistics and how the JMSDF might learn from these 
experiences in order to emulate successes where conditions allow and to avoid critical 
mistakes and failures. 

E. RESEARCH QUESTIONS 

There are seven research questions that define this project’s purpose. 

• How should JMSDF measure and evaluate the cost of a PBL contract? 
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• How should JMSDF measure and evaluate the performance of a PEL 
contract? 

• How should JMSDF consider performance measurement? 

• What are the primary and secondary risks associated with the PEL concept as 
it pertains to the JMSDF and what measures can be taken to mitigate them? 

• What kind of information system(s) should JMSDF construct to manage PEL 
contracts? 

• What kind of criteria should JMSDF consider when determining whether to 
use a PEL support strategy for a particular weapon system? 

• How can JMSDF implement and evaluate PEL contracts after they are 
executed? 

F. SIGNIFICANCE OF THE PROJECT 

This project will help the JMSDF reduce risks associated with PEL contracts by 
highlighting the experiences of two countries that have been implementing PEL for 
several years. Additionally, this project will provide direct guidance and input to the 
JMSDF in their development of PEL policy. At present, only one military officer in the 
MMC is tasked to implement PEL contracts in JMSDF. The JMSDF needs input and 
recommendations on implementing PEL without relying solely on the materials and 
documents provided by private defense contractors. 

G. METHODOLOGY 

This study analyzes publicly available literature and documentation on 
performance-based logistics contracting, as well as contractor logistics support 
contracting, to develop a summary of the U.S. experience with PEL. 
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II. ANALYSIS OF THE LITERATURE 


We began by selecting 76 documents that included peer-reviewed research, 
Department of Defense guidance, and various public and private reports that directly 
addressed PBL, Contractor Logistics Support (CLS) or outsourcing. Of the original 76 
documents, we chose 37 that described PBL implementation and outcomes based upon 
their research merit^^ (see Appendix A). We analyzed these 37 articles to summarize 
their findings and claims with regard to cost, performance, performance measurement, 
risk, information systems, appropriateness of a particular weapon system for PBL 
implementation, and organizational capability to evaluate, implement and manage a PBL 
contract. 

A. COST 

Eighteen articles directly addressed cost. The PBL literature contains not only 
claims of cost efficiency and reductions in total ownership cost, but also calls for more 
research and better data to assess whether, in fact, the theoretical claims made about PBL 
can be realized. 

Many organizations expect to save total ownership costs by implementing PBL 
(Keating & Huff, 2005; Reeve, 2001). Cohen (2007) found that cost-sharing support and 
maintenance services can generate "up to seven times as much profit as do sales of 
original products over the lifetime of product use to the contractors.” The Japan MoD and 
JMSDF also expect cost reduction and compression of the supply chain. Theoretically, 
outsourcing reduces costs, because many people think that the public sector is far more 
inefficient than the private sector (Sink, 1997). Further, officials inside the U.S. DoD 
claim they can reduce costs by implementing PBF (Ahern, 2004; Secretary of Defense, 
2004). In a theoretical paper by Tallant, Martin, and Hedrick (2008) the authors claim 
that the cost efficiency of PBF contracts is high. Cost efficiency refers to the 
effectiveness of action or performance outcome relative to the absolute cost. 

The other 37 documents not included in the literature analysis were contractor-developed 
documents that were little more than corporate advertisements or broad, simplistic overviews of PBL as a 
concept. 
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Theoretically, an award for good performance gives the supplier an incentive to improve 
in cost and performance thereby increasing the cost efficiency of the contract. Cohen 
(2007) and Kim, Cohen and Netessine (2007) have shown, through principal-agent 
models, the increase in cost efficiency as a result of a performance award. However, 
Cohen (2007) also observed that, while it is fair to assume that one must invest money to 
make money, it is not clear how to determine the appropriate amount of payment and 
expected cost savings for a PBL contract. 

In those rare cases where it is acknowledged that PBL may increase costs it is 
argued that it is a result of a premium for the additional risk contractors share as part of 
the contract (Nowicki, Verma & Parry, 2008). It is has also been suggested that highly 
reliable systems may have high performance contracting costs. Highly reliable 
equipment is often equipment that is also critical and its failure may not only represent a 
surprise event but also a time sensitive repair requirement for an organization. Because 
suppliers must be prepared to respond and repair the equipment quickly, there may be 
significant costs involved. On the other hand, highly reliable equipment may rarely break 
down and in a PBL contract this means the customer may feel as though they are paying 
without any services actually being rendered (Kim, Cohen, Netessine & Veeraraghavan, 
2008). 

Despite many claims that PBL can reduce costs, no documented evidence exists 
for such cost savings (GAO, 2008; GAO, 2008b; Inspector General, Department of 
Defense, 2004; Inspector General, Department of Defense, 2006; Landreth, Wilhelm & 
Corporon, 2005; Tallant, Martin & Hedrick, 2008). Not only is empirical evidence of cost 
savings through the use of PBL contracts lacking, there is no way to predict future cost 
reductions as a result of PBL implementation. While a performance award provides an 
incentive for suppliers to lower costs, there is very little systematic tracking of costs and 
performance. Individual military services have difficulty calculating total costs for their 
programs, particularly infrastructure support costs (Inspector General, Department of 
Defense, 2003). Additionally no statistical evidence supports a relationship between 
contract performance and the performance award (Kirk & DePalma, 2005). It is widely 
agreed, based upon empirical studies, that more cost data are needed, both in quantity 
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and quality, to evaluate cost appropriately and to price PBL correctly (Boito, Cook & 
Graser, 2009; Cohen & Nunes, 2008; Coryell, 2007; Department of the Navy, 2007; 
Inspector General, Department of Defense, 2003). The cost data required, for both PBL 
and non-PBL contracts, includes inventory and equipment costs as well as training costs, 
salaries and management fees, and facilities for both equipment and personnel. 

B. PERFORMANCE 

Ten articles directly address PBL performance. Performance improvement is one 
of the primary reasons the JMSDF would like to implement PBL. Ahem (2004) states 
that PBL can improve weapon system performance, however, this is simply a claim and 
very little empirical evidence backs the statement. The Inspector General, Department of 
Defense (2006) conducted an empirical investigation into H-6013 helicopters and found 
that availability, reliability, training opportunities workload and product was improved by 
using PBL. The GAO has also found instances of PBL improving performance (GAO, 
December 2008). However, other studies have pointed out that PBL may not be 
achieving the goals of improving readiness for major weapon systems (Inspector General, 
Department of Defense, 2004). An empirical study of Auxiliary Power Unitsi^ found that 
reliability did not improve through the use of PBL (Landreth, Wilhelm & Corporon, 
2005). Statistically, 52.1 percent of customers have noted a service-level improvement by 
outsourcing logistics functions, but 33.8 percent of customers felt that time and effort 
spent on logistics did not decrease (Sink & Langley, 1997). 

The business case analysis (BCA) is the primary instrument for determining 
whether a performance-based logistics contract should be considered and it is also the 
document that must be reviewed to determine whether the contract is performing as 
expected. However, it is not clear what cost elements should be in a BCA (there is no 
standard); nor has there been clear guidance from the Department of Defense on how the 
BCA should be constructed. Individual services are creating their own guidance and 

H-60: H-60 is one of the most popular military helicopters in the world. U.S. Army, Navy, Air 
Force and JMSDF use this type of helicopter. 

Auxiliary Power Unit: Auxiliary Power Unit is a small engine on an airplane that supplies electric 
power and compressed air when the main engines are not working. 
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standards for BCAs. In those instances where there were BCAs conducted and a PBL 
contract was used, the BCA was not always updated, validated or verified. 

The BCA is a set of methods to evaluate performance and help to make decisions 
in PBL implementation. The governmental organization must first define what should be 
included in a business case analysis and establish specific criteria and methods for 
evaluating PBL support. The BCA should be updated frequently during the lifecycle of 
the weapon system (GAO, December 2008; Ausink, Baldwin, Hunter & Shirley, 2002) 
and data should be collected in a standardized format (GAO, December 2008). The BCA 
should analyze PBL not only under peacetime operation but also under wartime 
operational scenarios and operating tempos, otherwise it will fail to capture the full costs 
of the contract should there be war (Coryell, 2007). 

An analysis of the PBL literature shows that performance measures, as well as 
their implementation and use, are heterogeneous. In some cases of PBL implementation, 
performance has not been measured. Kirk and DePalma (2005) found performance 
measurement to be critical in order to implement an effective PBL contract. However, in 
many cases, the government finds it difficult to establish measurable performance 
standards (Ausink, Baldwin, Hunter & Shirly, 2002). And while Buyukgural (2009) and 
Sols, Nowicki and Verma (2008) have developed mathematic models to measure 
performance, Kirk and DePalma (2005) insist that empirical performance data are 
required to evaluate PBL contracts. 

C. PERFORMANCE MEASUREMENT 

Eighteen articles directly addressed performance measurement. The literature of 
military PBL implementations addressed performance metrics in the following way. 

1. Variety of Performance Metrics 

Performance metrics can be classified as effectiveness (which includes 
availability, readiness, reliability and customer feeling), efficiency and response time. 
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a. Effectiveness 

Effectiveness describes how the goal is accomplished (Mentzer & Konrad, 
1991). Effectiveness includes availability, readiness, reliability and customer feeling. 
Setting effectiveness goals is very important for PBE, because without them, we cannot 
assess the applicability of PBE (Sols, Nowicki & Verma, 2008). Because this study 
addresses aviation, these effectiveness metrics are described in aviation terms. 

(1) Availability : Availability is “the percent of time that a system 
is available for a mission or the ability to sustain operations tempo” (Buyukgural, 2009). 
Some studies found that the “numerator of availability is not and should not be 
translatable to dollars” because, especially in the military, the mission is not monetary 
benefit (Doerr, Eewis & Eaton, 2005). Availability metrics include: 

• Partially mission-capable supply: “The percentage of time an aircraft can 
fly at least one but not all of its missions for reasons attributed to supply” 
(Boito, Cook & Graser, 2009, p. 36) 

• Not mission-capable supply: “The percentage of time an aircraft is 
grounded and cannot fly any of its missions for reasons attributed to 
supply” (Boito, Cook & Graser, 2009, p. 36) 

• Mission-incapable awaiting parts: “The percentage of time that an aircraft 
is unable to perform its assigned mission because of a lack of parts” 
(Boito, Cook & Graser, 2009, p. 36) 

• Aircraft availability: “Mission-capable hours divided by total possessed 
hours” (Boito, Cook & Graser, 2009, p. 38) 

• Mission-capable rate: “The percentage of all possessed aircraft capable of 
fulfilling at least one of their assigned missions” (Boito, Cook & Graser, 
2009, p. 38) 

• System availability and subsystem availability: The rate that shows how 
many hours we could use particular system or sub-system per total 
ownership time (Kim, Cohen & Netessine, 2007) 

• Operational availability: The rate that shows how many hours we could 
conduct operations per total operation demand (Nowicki, Verma & Parry, 
2008) 

(2) Readiness : Readiness is the rate of availability of parts or 
equipment. It is different from availability, because readiness does not always affect 
mission capability. Readiness measures include: 
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• Issue effectiveness: “The percentage of customer requests that have been 
filled by items in the inventory; includes the fulfillment of any request, not 
just requests for items the supply is authorized to stock” (Boito, Cook & 
Graser, 2009, p. 36) 

• Stockage effectiveness: “The percentage of customer requests filled by 
items that the supply system is authorized to stock” (Boito, Cook & Graser, 
2009, p. 36) 

• On-time fill rates: The rate that customer could get some parts or 
equipment on time (Kirk & DePalma, 2005, p. 27) 

(3) Reliability : “Reliability is the measure of a system in meeting 
mission success objectives” (Buyukgural, 2009) 

• Mean time between repairs: “Flying hours divided by repair actions” 
(Boito, Cook & Graser, 2009, p. 36) 

• Mean time between failure (MTBF): “A basic measure of reliability for 
reparable items; the average amount of time that all parts of an item 
perform within their specified limits” (Boito, Cook & Graser, 2009, p. 36; 
Kirk & DePalma, 2005, p. 27) 

• Break rates (BR): “The number of breaks, defined as landings with write¬ 
ups requiring major maintenance that ground the aircraft, per sortie” 
(Boito, Cook & Graser, 2009, p. 37) 

• Mean Flight Hours Between Removals (MFHBR)): The average number of 
flight hours before particular parts are removed. MFHBR includes regular 
maintenance and contingency maintenance (Kirk & DePalma, 2005, p. 27 

• Mean Flight Hours Between Unscheduled Removals (MFHBUR): The 
average number of flight hours before particular parts are removed. 
MFHBUR exclude regular maintenance (Kirk & Depalma, 2005, p. 27) 

• Mission reliability: The rate that shows number of successful missions per 
total number of missions (Nowicki, Verma & Parry, 2008) 

• Mean down time: Mean time during which particular system could not be 
used (Nowicki, Verma & Parry, 2008) 

(4) Customer feelings : One of the metrics to measure availability, 
readiness and reliability is customer feelings. Customer feelings can be very important— 
if a squadron feels that the service provided is very convenient (or inconvenient) then this 
is useful feedback from a resource allocation and overall management standpoint. 
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However, customer feelings are often ignored, especially when the service is provided by 
the government, to the government. To measure human behavior is difficult, so we tend 
to skip these measurements (Mentzer & Konrad, 1991). 

• Customer satisfaction: Customers feel satisfaction when their objective is 
fulfilled (Lambert & Burduroglu, 2000) 

• Customer-value added: Customer-value added is “perceived value of 
company’s offer” divided by “perceived value of competitive offers” 
(Lambert & Burduroglu, 2000) 

b. Efficiency 

Efficiency “is the measure of how well the resources expended are 
utilized” (Mentzer & Konrad, 1991). Efficiency metrics include: 

(1) Cost per Unit Usage : “The total operating cost divided by the 
appropriate unit of measurement for a given system” (Buyukgral, 2009, p. 24) 

(2) Eogistics footprint : “The Government/contractor size or 
presence of deployed logistics support required to deploy, sustain and move a system. 
The measurable elements of logistics footprint include inventory/equipment, personnel, 
facilities, transportation assets and real estate” (Buyukgral, 2009, p. 24). 

c. Response Time 

Response time is the time needed to draw output from some input. 
Response time metrics identified in the literature include: 

(1) Repair turnaround time : “A measure of the length of time to 
repair an item and return it to the stock system” (Boito, Cook & Graser, 2009, p. 36) 

(2) Mean time to repair : “A basic measure of maintainability: the 
total maintenance time divided by total number of failures” (Boito, Cook & Graser, 2009, 
p. 37) 

(3) Eogistics response time : “The period of time from logistics 
demand signal sent to satisfaction of that logistics demand. ‘Eogistics demand’ refers to 
systems, components, or resources (including labor) required for system logistics 
support” (Buyukgral, 2009, p. 24). 
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2. 


Key Issue for Performance Measurement 


Studies have suggested steps for implementing performance metrics. They are: 1) 
Select Performance Metrics, 2) Establish Baseline Values for Each Performance Metric, 
3) Set Target Values for Each Performance Metric, 4) Define an n-Dimensional Reward 
Scheme, and 5) Measure the Actual Effectiveness (Sols, Nowicki & Verma, 2008). 
Because of the number of available metrics, we must carefully consider which metrics we 
should use. Good measurement should 1) cover all aspects of the process being 
measured, 2) be appropriate for each situation, 3) be applied in a way that minimizes 
measurement error, and 4) be consistent with the management reward system (Mentzer & 
Konrad, 1991). After we select metrics, however, if they do not work well, we must 
replace them as necessary (Mentzer & Konrad, 1991). One of the biggest keys to 
succeeding in PBE is to select appropriate metrics that represent the system well, because 
metrics are the fundamental tools with which to evaluate PBE (Kim, Cohen, Netessine & 
Veeraraghavan, 2008; Eandreth, Wilhelm & Corporon, 2005; Sols, Nowicki & Verma, 
2008). Of course, the government should set goals for each metric, specifying the 
performance data that should be collected (Cohen, 2007). 

3. Problems of Measurement 

Measurement is very important for PBE management, but there are some pitfalls 
that include: 


a. Difficulty of Determining Measurable Performance Standards 

One study found that it was difficult to determine "measurable 
performance standards” (Ausink, Baldwin, Hunter & Shirley, 2002). Eor example, human 
behavior is difficult to measure, so we tend to skip these measurements though they are 
very important (Mentzer & Konrad, 1991). 

b. Comparability of Measurement 

Some metrics do not fit for all situations, so we often have to modify those 
metrics (Mentzer & Konrad, 1991). Eor example, if we want to evaluate the maintenance 
performance of an aircraft engine, we may use flight hours for the denominator of the 
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metric because the engine is working during flight, but if we want to evaluate the APU 
then flight hours may not be the appropriate denominator because the APU is not 
working during flight. 


c. Measurement Error 

Because it is difficult to find out what factors affect certain results, we 
sometimes collect inappropriate data (Mentzer & Konrad, 1991). 


Table 1. Dimensions of Logistics Service Quality 


Category 1 

Category 2 

Example 


Availability 

Mission-capable rate 

Operational availability 

Partially mission capable supply 

Not mission capable supply 

Mission incapable awaiting parts 

System availability, sub-system availability 

Aircraft availability 

Effectiveness 

Readiness 

Issue effectiveness 

Stockage effectiveness 

On time fill rates 


Reliability 

Mean time between repairs (MTBR) 

Mean time between failure (MTBF) 

Break rates (BR) 

Mean Flight Hours Between Removals(MFHBR) 

Mean Flight Hours Between Unscheduled Removals(MFHBUR) 

Mission reliability 

Mean down time 


Customerfeelings 

Customer satisfaction 

Customer-Value added 

Efficiency 

Cost per Unit Usage 

Logistics footprint 

Response time 

RepairTurnaround 

Mean time to repair 

Logistics Response Time 


D. RISK 

Fourteen articles in the literature reviewed directly addressed risk. According to 
Spekman and Davis(2004), “risk is defined as the probability of variance in an expected 
outcome.” The literature reviewed concerning military PBL implementations addresses 
risk in the following way. 
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1. Risk in Supply Chain 

Traditionally, risk permeates the supply chain, including such areas as inventory 
management, transportation, and financing. The best solution to allocating risk among the 
supply chain (or channel) members can be achieved if channel members are risk-neutral 
and the second-best solution involves a contract that combines a fixed payment, a cost¬ 
sharing incentive, and a performance incentive (Kim, Cohen & Netessine, 2007). Some 
PBL contracts may transfer supply chain risks from customers to suppliers (Cohen, 2007; 
Keating & Huff, 2005); therefore, suppliers demand a risk premium (Cohen, & Nines, 
2008). The degree of risk transformation from customers to suppliers depends on the 
degree of authority or agency granted to the supplier in the PBL contract (Doerr, Lewis & 
Eaton, 2005). That means that if the customer gives more authority to the supplier, more 
risk will transfer from customer to supplier. However, the ultimate party responsible for 
any problems or failures in the supply chain is the government. 

2. Contractor Technical Standards May Become Lower 

Because of the heavy competition in cost, the government may accept lower 
standards of technology and accept higher and unrecognized risks (Tallant, Martin & 
Hedrick, 2008). One study found risk in not realizing the full capability and quality of 
third-party employees providing logistics services, due to inadequate managerial systems 
within the service-providing firm (Sink & Langley, 1997). 

3. Ethics of Contractors 

One study found that there are contractors and third parties who did not work in 
an appropriate manner or worked in a manner that was unethical (Chuter, 2009). In PBL 
contracts, suppliers get money by achieving performance such as availability; without 
quality metrics in a contract, suppliers may cut comers just to achieve performance, even 
if such corner-cutting could or does result in a significant mishap. 

4. Skill Drain 

As a form of outsourcing, PBL will necessarily transfer public sector work to the 
commercial sector, which means skilled manpower will drain from the public military to 
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the private civilian sector (Chuter, 2009). If PBL is applied to an entire weapon system, it 
may erode skills that currently military personnel have, because PBL will reduce their 
jobs, and therefore make it much more difficult to regain that organic capability should it 
be desired to do so in the future (GAO, 2008b; Reeve, 2001). Skills include not only 
technical skills but also management skills and once those skills are eroded, it is very 
costly to replace them (Chuter, 2009). 

5. Risks Related to Cost 

Any use of the weapon system beyond the contracted hours increases costs 
significantly and also requires negotiation of a modification to the existing contract; this 
is a risk that is borne by the government and contractor to varying degrees, depending 
upon how the contract is written. If the renegotiation takes time or is expensive, it may 
have an adverse impact on operations (Kirk & Depalma, 2005; Reeve, 2001). Second, 
"CLS contracts often guarantee a large amount of funding to the contractor in each fiscal 
year [and] this limits the flexibility of the government to reduce funding levels without 
violating the terms of the contract" (Boito, Cook & Graser, 2009). A third risk is 
associated with pricing the contract correctly, so analyzing the financial risk of a 
performance-based contract is a critical skill (Cohen & Nunes, 2008). 

6. Capability to Assess PBL 

If PBL is applied to an entire weapon system, the customer often lacks 
maintenance and logistics data to analyze PBL without cost (Boito, Cook & Graser, 
2009). It is not unreasonable to assume that suppliers would charge significant sums of 
money to provide such data if they enjoyed a monopoly on such information. 
Additionally, if the customer cannot acquire those data, their BCA becomes unreliable 
(Kirk & DePalma, 2005). This presents a paradox, because the bigger the PBL contract 
becomes, the more difficulty the customer may have in conducting a BCA - meaning 
they may not be able to assess PBL appropriately or with any reasonable level of 
confidence. 
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7. Security of Information System 

In PBL, data exchange and information sharing with contractors may be 
significant. When data sensitive information is shared between the government and an 
outside organization security problems are likely to occur (Spekman & Davis, 2004). 

8. Contract Change 

Some PBL contracts are fixed price contracts, and those prices are calculated 
by historical data. However, in PBL contracts for airplanes, if flight hours go up 
significantly because of deployment or some other reasons, suppliers will have huge 
deficits. As a result, the contractor may demand a change to the contract rather than face 
an adverse financial impact that might damage the firm or cause them to go out of 
business. (Kirk & DePalma, 2005) 

9. Risk in Wartime 

In wartime, contractors are not authorized to directly engage in armed battle and 
therefore require protection; this becomes a significant burden for combat squadrons, as 
they need additional force protection in order to provide safety to contractors (GAO, 
2008b; Reeve, 2001). There are also considerable limitations on the timeframe for 
deploying contractors because they may not enter a particular area until the military 
commander assesses that area as safe (Reeve, 2001). 

E. INFORMATION SYSTEM 

Four articles directly addressed the information system for PBL. The information 
system is important in order for the customer and supplier to maintain the efficiency and 
competitiveness of PBL and to be able to evaluate it. The literature on military PBL 
implementations addresses the information system in the following way. 

1. Information System to Improve PBL 

Necessary data should be distributed to all PBL contractors, because currently, 
individual suppliers tend to keep most of data to themselves and subcontractors can only 
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access those contracts that are less attractive. However, if subcontractors could access 
those data, they would also be able to compete in some parts of PBL (Secretary of 
Defense, 2004). 

2. Information System to Keep Ability 

The information system is very convenient for tracking cost data. The customer 
should make efforts to collect standardized data to track the status of PBL efforts, so as to 
maintain the capability for continuous PBL evaluation (GAO, 2008; Inspector General, 
Department of Defense, 2004). Currently, GAO insists that customers should get benefit 
from IUID15 and passive RFID^^ to grasp how materials are used and to have cost data 
(GAO, 2009). 

F. WEAPON SYSTEM 

Six articles directly addressed weapon system selection for PBL. Some studies 
insisted that converting all contracts to PBL is not optimal (Cohen, 2007). For example, if 
we want to make one-time, short-term contract, PBL may not fit. The contract may expire 
without any benefit for the customer because of the short term, or the supplier may not 
achieve a certain performance level because they have insufficient time to apply their 
skills. The literature of military PBL implementation addresses weapon system selection 
in the following way. 

1. Four Levels of PBL Contracts 

There are four levels for PBL: Level 1: components such as aircraft tires. Level 2: 
major subsystems such as aircraft engines. Level 3: platform availability such as F-117 
Nighthawk, and Level 4: Mission, setting the stage for the future—achieving true pay for 
performance such as the Army shadow tactical unmanned aerial vehicle program. The 
government should consider what kind of work it will give to the contractors for each 
level (Vitasek, Cothran, Geary & Rutner, 2006). 

lUID: lUID stands for Item Unique Identification. This system is used by DoD to identify 
individual parts or equipment. 

RFID; RFID stands for Radio Frequency Identification. This system can identify individual parts, 
boxes, or vehicles that have passive or active RFID tag. 
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2 . 


Criteria of Theoretical Studies 


Doerr, Lewis and Eaton (2005) suggest that PEL is good for those markets where, 
the system has external markets for services, the system has clear and objective outcomes 
to measure and contractors may be better equipped and able to support high technology 
or short lifecycle technology than the government. By using contractors, we can reduce 
the burden of maintaining modern, complicated equipment, because contractors can cover 
the whole life cycle of particular equipment and they can have strategic advantages in 
technology. This technical advantage helps PEL efficiency (Reeve, 2001). 

On the other hand, PBL may not be efficient if we apply it to highly reliable 
systems (Kim, Cohen, Netessine & Veeraraghavan, 2008). Those systems may need no 
after-service during the entire contract term and, once broken, often have high systems 
costs. The result is that those contracts become very high risk/high return, which is not 
good for the customer or supplier. 

3. Criteria of U.S. Military Experience 

The U.S. Navy prefers to use PBL for expensive or delicate items, those for which 
readiness is a critical issue, and hard to manage candidates. It also says that “there must 
be a vendor who is willing to contract with the customer” and “the vendor must be 
affordable to the customer” (Kirk & DePalma, 2005). In the U.S. Air Force, newer 
aircraft tend to use PBL more than older aircraft (Boito, Cook & Graser, 2009). 

G. ORGANIZATIONAL CAPABILITY 

Sixteen articles directly addressed organizational capability. The literature on 
military PBL implementations addressed organizational capability in the following way. 

I. Implementing PBL 

At first, the customer should define the roles and responsibilities of contractors 
and government employees, which means defining when we should use contractors under 
what situation (GAO, 2008b). Once the customer decides to implement PBL, it should 
understand how suppliers do things, so that the customer can craft a solid contract with 
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suppliers (Ausink, Camm & Cannon, 2009). To do that, the customer needs to consider 
an in-depth evaluation of various agencies’ use of performance-based contracting as it 
proceeds with this effort (GAO, 2002). Furthermore, the government needs to have a 
better understanding of how commercial firms have successfully implemented 
performance-based services acquisition (Ausink, Camm & Cannon, 2009). Managing 
suppliers is a critical capability that the organization must have in order for PEL to be 
effective (Cohen & Nunes, 2008). 

PEL guidance and training requirements should be established so that all 
managers who take charge of PEL can follow these steps because, normally, those 
managers change frequently. If high turnover results in lost knowledge, PEL becomes 
inefficient (Inspector General, Department of Defense, 2004; Mendoza & Devlin, 2005). 

Nowicki, Verma and Parry (2008) found that the government should consider the 
following when making contracts: 

Clearly define the system for which support is sought; 

Include definition of boundaries, primary external interfaces, definition of 
primary system elements such as hardware, software, human actions and activities, and; 

Include details of support objectives, contract exclusions, system operational life, 
mission profiles and durations, measures of performance which includes frequency of 
measurement, continuity of key personnel and identify key focal points. 

2. Evaluating PEL 

The customer should have the ability to analyze current situations, such as 
manpower, organizational effectiveness and real cost (Tallant, Martin & Hedrick, 2008). 
To analyze current situations, the customer should obtain necessary PEL data (Eoito, 
Cook & Graser, 2009). EGA guidance should be established, because it can give the 
customer the ability to evaluate PEL (Inspector General, Department of Defense, 2004). 
EGA guidance should clearly define “what should be included in a business case analysis 
and to establish specific criteria and methods for evaluating PEL support” and “when 
business case analyses should be updated during the weapon system life cycle” (GAO, 
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December 2008). The customer should implement formal oversight procedures as well, 
so that they can evaluate PBL according to a common standard (GAO, 2008a). 

3. Maintaining Capability 

Sometimes, the customer needs to reorganize to become an intelligent customer, 
because they neglect to maintain the ability to implement and evaluate PBL (Chuter, 
2009). Normally, reorganization costs are extremely high; therefore, the customer should 
retain the choice of logistic service methodology so that they keep their ability to assess 
PBL (Boito, Cook & Graser, 2009). To do that, the customer should establish PBL 
training to keep its skills (Inspector General, Department of Defense, 2004; GAO, 
2008a). 
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III. FINDINGS 


A. COST 

1. Cost Reduction 

Though most organizations expect cost reductions as a result of implementing 
PBL, we should be aware that PBL does not always reduce costs, as many empirical 
studies have found. If the government takes no provision to ensure the lowering of costs 
during the drafting of a PBL contract, it is very difficult to reduce costs once the contract 
is in place. We found that, to have the benefit of cost reduction, we should do several 
things: 


a. Cost Data Management 

For cost reduction, cost data management is significant for government. 
The government should collect cost data not only of the PBL contract itself, but also for 
other actions such as maintenance, personnel, facilities, training, administration, 
documentation, technical data, and disposal. Cost data for contracts without PBL are 
really important, because if we do not have those cost data, we cannot find out whether 
we could reduce the cost or not. This idea is very straightforward but, in fact, many 
organizations (including JMSDF) often fail to have total cost data without PBL contracts 
for particular weapon systems. Once we could have useful cost data, we should track it 
continuously and regularly, because all cost components change rapidly and, if we fail to 
track cost data, risks due to the PBL contract will increase. 

b. Government Should Have the Ability to Evaluate PBL Contracts 

The government should have the ability to evaluate PBL contracts. The 
goal of any contractor is to maximize profits, so the government should not rely on cost 
data management by those contractors. The JMSDF may desire to outsource the 
evaluation of a potential PBL contract, or the business case analysis (BCA), to a third 
party, however, it is difficult for a third party to have accurate and sufficient cost data, 
because they do not have enough access to all documents and information at the 
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operational squadron level, and it will likely be difficult for a contractor to evaluate costs 
from inside the organization. In addition, some third parties may be untrustworthy or 
incompetent, so if the government has no ability to evaluate PBL contracts, it cannot 
evaluate accurately the reports submitted by those third parties and may subsequently 
enter into a poor, risky contract. Of course, if the government wants to have the ability to 
evaluate PBL contracts, it must bear some costs (e.g., training cost, manning cost and 
investment cost); generally, however, those costs should be smaller than the expected 
cost savings in the prospective PBL contract assuming the business case analysis contains 
proper, thorough and accurate cost calculations. 

c. Government Should Maintain Marginal Administration and 
Technical Skills 

It is very important for government to maintain marginal administration 
and technical skills, because it will lower future contract replacement or switching costs 
and the government should always reserve the option to cancel a contract. If we cut all 
applicable administration and technical skills, we can save money in the short-term, but 
once we lose those skills, the cost and time necessary to rebuild them may be immense. It 
is worth observing that the U.S. Army gave up the PBL contract for the Stryker because 
they could not effectively operate it under wartime conditions, due to increased force 
protection requirements for the contracted laborers on the battlefield; for every contractor 
there was a fixed and variable force protection cost and this drove up the logistical 
requirements as well as the personnel requirements. If we can keep replacement costs low, 
it will give strong incentives to contractors to reduce the cost. If they increase contract 
fees, contractors can expect that government will replace the PBL contract, because the 
government still has the ability to maintain a particular weapon system by itself. 

Second, administration and technical skills are connected directly to the 
ability to evaluate PBL contracts in cost. If we have no administration and technical skills, 
we cannot collect or predict sufficient and appropriate cost data, because we do not have 
the knowledge to maintain a particular weapon system. From this point of view, we can 
also give incentive to contractors to reduce cost if we have marginal administration and 
technical skills, because we can evaluate cost more appropriately. 
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d. Apply Monetary Incentives 

In theory, monetary incentives should work in a PBL contract to reduce 
costs because the cost reductions and improved performance the contractor delivers will 
offset the incentive payments (Sols, Nowicki & Verma, 2008). Empirical studies have 
found that, in some instances, monetary incentives improve performance and lower cost, 
but the exact amount by which performance was increased or costs were reduced is 
uncertain (Kirk & DePalma, 2005). The important conclusion is that the government 
should track the relationship between monetary incentives and performance, so that the 
government can have an appropriate amount of money for incentives. 

2. Risk Premium 

The government cannot calculate the appropriate price of a PBL contract just by 
having all the cost data of contractors, because the government has to take a risk premium 
into account. In PBL contracts, more risks will move from the government side to the 
contractor side as the contract level become higher, so it is natural for government to pay 
some money for contractors to accept some risks. The government should therefore 
consider the appropriate risk premium. Risk premium should not be considered simply as 
a profit of contractors, because contractors have to pay some costs (e.g., management 
cost, insurance cost and training cost) to take on the new risks. 

3. Cost Over Life Cycle Time 

The government should consider the costs, not of one PBL contract, but of all 
PBL contracts that will be made over the life cycle of a particular weapon system. Most 
PBL contracts are long-term; in fact, the JMSDL considers 5-year contracts. However, in 
most cases weapon system life cycles are longer than most PBL contracts or 5 years, so 
the government should have some plan to stretch PBL contracts of particular weapon 
systems over the projected life cycles of those systems. In these plans, the government 
should roughly estimate the increase of PBL contract price, and should have criteria to 
replace a PBL contract with an organic capability. The cost of transitioning from the PBL 
contract to an organic capability should also be recognized as part of the cost of the PBL 
contract at the outset. 
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4. PBL Contract Price and Replacement Cost 

Figure 4 shows the cost of government and contractors, and the margin required 
to increase costs. To simplify this problem, we assume that in this case, contractors will 
do all of the administrative work, maintenance, and logistics for a particular weapon 
system. In Case 0, a PBL contract has not been implemented, so the government has 100 
percent of the capabilities to include administration and technical skills; therefore, the 
estimated replacement cost should be zero. On the other hand, if the government wants 
PBL to reduce the cost, contractors have to offer lower PBL contract prices than the 
actual cost to the government; so, in Case 0, the estimated cost of contractors should be 
lower than the actual cost of government. After a PBL contract begins, because the 
government wants to reduce its total cost, it will remove all the capability for a particular 
weapon system as an overlapped capability and waste. 

In Case I, the government removed all the capabilities, driving up the estimated 
replacement cost due to this loss of capability. If it wanted to replace PBL, it would have 
to reconstruct facilities, buy or accumulate know-how, recruit soldiers and educate and 
train them; this replacement cost would likely become higher than the annual cost of 
government without a PBL contract over some period of time. Thus, it would become 
difficult for government to replace a PBL because the replacement cost is so high. On the 
other hand, contractors would have the margin to increase cost (or annual contract price) 
up to the replacement cost. Normally, contractors are very smart; they never overlook this 
margin. Thus, we can easily assume that contractors will increase the contract price in the 
second or third term of a PBL contract. 

In Case 2, a PBL contract is implemented but government retains marginal 
capabilities. In this case, government has to use some money to maintain its marginal 
capabilities, but its cost is not prohibitive because it will reduce the number of its 
employees to just those required to maintain facilities and technical and managerial 
know-how. In fact, in fiscal year 2009, personnel cost accounts for 44.1 percent of the 
defense budget in Japan (Ministry of Defense, 2009). On the other hand, estimated 
replacement cost is also relatively smaller, because the government maintains its 

marginal capability and, if it wants to replace the PBL, it may train or recruit additional 
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personnel to perform the function, In Case 2, the government maintains its very skilled 
personnel, so it is relatively easy to educate new personnel. In Case 2 of Figure 4, actual 
annual cost of government plus actual annual cost of contractors is greater than actual 
annual cost of government in Case 0. This assumption is reasonable because many 
empirical studies found no evidence of cost reduction by implementing PEL. If the 
government accepts this cost increase as a compensation for performance improvement, 
this situation is acceptable, but if the government is focused on cost reduction, then it will 
find this situation to be unacceptable. In that case, contractors will have some incentive to 
reduce costs so that the actual annual cost of government plus the actual annual cost of 
contractors becomes smaller than the actual annual cost of government in Case 0. 



CaseO Case 1 Case 2 


Case 0 : Government has 100% of the capability to perform a given 
function and replacement cost is zero. Estimated actual cost 
for the contractor to provide the service is lower than the 
actual cost to the government 

Case 1 : Government eliminates 100% of the capability to perform a 
given function and the estimated replacement cost is high. 
Contractor may increase their price up to the capability 
replacement cost of the government. 

Case 2 : PEL contract is implemented but government retains some 
marginal level of the capability to perform the given 
function that has been outsourced to the contractor. 



Actual annual cost of government 
Estimated replacement cost 
Actual annual cost of contractors 
Margin to increase annual cost 


Figure 4. Cost of government and contractors, and margin to increase cost from annual 

view point 


Training and recruiting additional personnel to take over a function that has been outsourced may 
require significant time and money and therefore a transition plan or exit clause should be put in place in 
the contract to provide the government with enough time to build the capability necessary to perform the 
function effectively. 
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Figure 5 shows the relationship between organic capability and capability keeping 
cost or PEL replacement cost. Capability keeping cost includes facility maintenance cost 
and cost to maintain know-how as fixed costs, and personnel cost as a variable cost. 
Capability keeping cost will increase or decrease as organic capability increases or 
decreases. If the government removes all of its capability, capability-keeping cost 
becomes zero, but if the government maintains some capability, it needs to assume at 
least the fixed cost. We assume that the capability keeping cost will be linear because 
personnel cost is the only variable. 

PEL replacement cost includes facility construction cost and buying or 
accumulating know-how cost as a setup cost and recruiting cost and retraining cost as 
variable costs. PEL replacement cost is a one-time cost. If government removes all of its 
capability, PEL replacement cost becomes very big, because government has to pay the 
setup cost. PEL replacement cost will be decreased as organic capability increases and 
when government has 100 percent of capability, PEL replacement cost becomes zero. We 
assume that PEL replacement cost goes down in an inverse proportion, because it is 
much easier for 1,000 soldiers than it is for 10 soldiers to retrain 100 soldiers. 

In Figure 4, the total represents capability keeping cost plus PEL replacement cost. 
As the figure shows, at first total cost goes down as organic capability goes up, but at a 
certain point begins to rise as organic capability goes up, so there is a lowest point. If we 
add PEL replacement cost to longer-term capability keeping cost, this lowest point moves 
from the lower right to the upper left. 
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Life cycle term (20+ yrs) 



Capability keeping cost: It includes facility 
maintenance cost and cost to maintain know-how as 
fixed costs, and personnel cost as a variable cost. 

PBL replacement cost: it includes facility 
construction cost and buy or accumulating know¬ 
how cost as a setup cost, and recruit and retrain cost 
as variable costs. 

Total : This number is capability keeping co.st plus 
PBL replacement cost. 


Capability keeping cost 
PBL rcpiaccmcnl cost 
Total 


low 

Organie Capability 


hiuh 


Figure 5. Relationship between organic capability and capability keeping cost or PBL 

replacement cost 


Figure 6 combines Figure 4 and Figure 5. Case 2 is the optimal case, and the 
government has to seek this point. The government often considers cost from the 
viewpoint of a single fiscal year viewpoint, so the optimal point is relatively toward the 
right of the figure, but if the government can consider the longer term, it will move from 
right to left, and can save more capability keeping cost and total cost with PBL contract. 

Though the cost is higher in Case 2 than in Case 0, this does not directly mean 
that total cost is higher in Case 2, because PBL often increases service level and can 
increase mission-capable rate, meaning that government needs fewer of each weapon 
system in total. Normally, government decides the number of weapon systems by 
considering the international situation then divides those numbers by mission-capable 
rate; from this, it will estimate the necessary number of weapon systems to possess. So, if 
mission-capable rate goes up, the necessary number of each weapon system will go down, 
and the acquisition cost or holding cost will go down. 
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Figure 6. PEL price and replacement cost 

B. PERFORMANCE 

1. Performance Measurement Is Important for PBL Contract 

Empirical studies found that a lot of PBL programs achieved high performance 
with a variety of weapon systems (Ahem, 2004; GAO, December 2008; Inspector 
General, Department of Defense, 2006). However, it is difficult to measure the 
performance because appropriate data is not collected. Additionally, it is even more 
difficult to measure the cost for performance —that is, measure the performance for a 
given resource investment. In fact, some studies could not find evidence that PBL 
increased performance (Inspector General, Department of Defense, 2004; Landreth, 
Wilhelm & Corporon, 2005). Performance evaluation is significant in PBL contracts 
because performance is the selling point of PBL. No one can evaluate contractors or the 
price of PBL contracts without evaluating performance appropriately, because we cannot 
bid some goods and services without grasping their capabilities or results. So, under PBL 
contracts, the government should evaluate performance continuously and regularly. The 
government is responsible for checking performance as it checks the number and quality 


of other goods that are delivered by contractors. 
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2. Appropriate Performance Data Are Needed 

One of the most serious problems is that it is difficult to identify an appropriate 
measure of performance. If we cannot find a good measure, we cannot evaluate the 
performance of a PEL contract appropriately. After identifying an appropriate measure, 
we have to collect data constantly because performance of PEL contracts fluctuates every 
time and we may misunderstand the performance by the information from a snapshot of a 
particular time. Therefore, the government has to keep making efforts to correct 
appropriate performance data by good measurement. In this meaning, even if the 
government receives high performance from implementing PEL, that does not always 
mean that government time and effort for logistics will be reduced. 

3. BCA is Necessary To Evaluate PEL 

EGA provides the necessary methods and techniques to evaluate PEL contracts. 
EGA is not just a cost benefit analysis; it is composed of all analyses that are needed to 
evaluate PEL contracts. In other words, EGA is not one particular method, so 
government has to define EGA by itself and has to consider what should be included in 
EGA. EGA includes metrics selection and data collection, so government automatically 
has to continuously update EGA. The more frequently the government updates EGA, the 
more appropriately the government can evaluate PEL contracts and grasp performance of 
PEL. 

The government tends to analyze PEL in the case of peacetime conditions, but it 
should also consider wartime operations in its EGA. Though JMSDF has not experienced 
severe war and most of their operations have been executed under peace situations or 
close to peace situations, JMSDF is designed to operate during war, and has to keep 
maintaining its weapon systems in such situations. Therefore, JMSDF has to collect or 
predict the data under combat conditions and put that information into its EGA. 
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C. PERFORMANCE MEASUREMENT 

1. Significance of Selecting Appropriate Metrics 

The most important thing to get correct with PBL is appropriate and effective 
metrics to measure performance. If we fail to select good metrics, the applicability and 
effectiveness of the BCA will be reduced or lost, because BCA is implemented by using 
the information provided by those metrics. For that reason, the government must strive 
toward better metrics. The government has to recognize the difficulty of measurement 
and measurement error, and has to reconfirm the measurement continuously and 
regularly. 

2. Metrics Selection 

It is difficult to find the best metrics for a particular PBL contract in one try; in 
other words, we can have much better metrics after several attempts, so metrics should be 
evaluated and updated periodically. If a particular metric is not effective then it should be 
changed, and efforts made to improve performance metrics so that we can evaluate PBL 
more appropriately. On the other hand, changing performance metrics has implications 
for writing contracts and contract durations because it may be necessary to change the 
metrics in a given contract. For this reason, there needs to be flexibility in the contract to 
change the metric but not so much flexibility as to open up all parts of the contract, which 
would effectively mean a renegotiation that increases costs. The government also has to 
make efforts to reduce the number of trials needed to determine satisfactory metrics; this 
will reduce the opportunities to change contracts and increase costs. To do that, it is 
better for the government to set standardized steps to choosing metrics. 

D. RISK 

1. Risk Sharing 

One of the features of PBL is risk sharing. The contractor will likely charge for 
the cost of taking on risk for the government and the premium for that risk will be 
reflected in the contract price. So, PBL is not such a simple program—there are 
complexities. We should not regard the risk premium as a simple profit for contractors. 
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because it is the value of risk sharing. The government can reduce risks associated with 
inventory, transportation or contingency expenditure caused by particular trouble, and 
contractors sell these risk reductions like insurance companies. 

2. Chain of Command 

There is also risk associated with not having the particular function or service 
directly under the control of the government and therefore subject to the chain of 
command. For example, a dispute must be resolved through civil (or administrative) 
courts as opposed to the direct chain of command (or the Uniform Code of Military 
Justice, in the case of the U.S.). 

3. Organization Skills 

Administration and technical skill will more or less drain from the government, 
because contractors will assume some duties that were conducted by government 
employees. If the government loses entire skill sets, replacement cost becomes very high 
and PEL evaluation capability becomes very low. Replacement cost growth means that 
the incentives for the government to replace PEL contracts will decrease and it will be 
difficult for the government to give up PEL; this is because, if replacement cost becomes 
high, it is more difficult to persuade finance sections to replace PEL. If the government’s 
PEL evaluation capability becomes low, the government is more likely to make 
inappropriate and disadvantageous contracts, and once the government makes 
unfavorable contracts, it cannot notice that these contracts are not appropriate. Then 
government will have no option to continuing inappropriate PEL contracts. 

The government should not forget that the government itself is the competitor of 
contractors because it has same skills (before PEL contracts) as competitors have for 
particular weapon systems. If the government loses its skills, the strongest competitor 
will be dismissed, and we can easily predict that the PEL contract price goes up. 

4. Data Sharing 

If PEL contracts expand to cover almost all weapon systems, it becomes harder 
for government to have maintenance and logistics data, either because it does not need to 
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gather data itself or because contractors restrict direct access to the pertinent cost or 
performance data and, generally, charge high rates when they do provide access. If the 
PBL contract expands, the government should analyze it more strictly, because unsuitable 
parts of such a big contract could lead to huge waste. It is something of a paradox 
because the bigger the PBL contract becomes, the more difficulties the customer 
encounters in BCA, leading to inaccurate assessment of PBL. So the government should 
mention data treatment or data ownership in the PBL contracts in order to maintain 
access to data that are needed to implement appropriate BCA. 

There is another problem in data sharing. Security issues may arise in PBL 
contracts, due to governmental need to share a lot of data with contractors. For example, 
if contractors work in the hangars at military air bases, the government may need to take 
certain measures to guard secrets. 

5. Wartime Operations 

Generally, during war, a PBL contract is not suitable because contractors cannot 
fight and they need enough protection by military people, and contractors cannot work in 
the place where safety is not guaranteed. For this reason, contractors cannot work on 
ships. 

E. INFORMATION SYSTEMS 

I. Information Systems to Improve PBL 

We have to shrink the turnaround time of information; for example, if we use 
some parts or some assemblies in our hangar then that information should be sent 
immediately to the contractor so that they may reduce the inventory or turnaround time. 
The inventory or turnaround time reduction in the contractors’ section directory connects 
to the price of the PBL contract, so it is significant not only for contractors but also for 
the government to have immediate information exchange. Information systems must be 
integrated with the work on the shop floor without delay. For example, if maintenance 
work is performed on the shop floor but the usage of spare parts or maintenance man¬ 
hours is not entered into the system until months later then it is impossible to accurately 
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plan and forecast for resources such as parts and labor, and turnaround time goes up. This, 
in turn, can cause safety stock and pipeline stock increase. To avoid this, the government 
should improve information systems for PBL that connect government and contractors. 
RFID and lUID may be very beneficial as mechanisms for transmitting information about 
usage of parts or the status of a weapon system or component. 

2. Information Systems to Evaluate PBL 

An information system is also very important to collect necessary data to evaluate 
PBL contracts, because the government cannot evaluate PBL by its own information 
alone. The government should have some cost and performance data from the 
contractor’s section so that government can implement appropriate BCA. When the 
government collects data, cost and performance data should be collected by standardized 
format so that the government can track those data. This effort will help the government 
to evaluate PBL appropriately and frequently. 

F. WEAPON SYSTEM 

1. Weapon System Selection 

PBL is not right for every situation, so the government should carefully consider 
for which elements they should implement PBL contracts. To select weapon systems for 
PBL, the government should first settle upon the criteria by which they are operating. 

a. Suitable Weapon Systems for PBL 

High-technology weapon systems or components are good for PBL 
contracts, because government people will be released from the burden to understand and 
struggle with such a complicated system in some extent. 

b. Unsuitable Weapon Systems for PBL 

There are some unsuitable weapon systems for PBL. For example, if a 
particular weapon system is very special (i.e., particularly complex or expensive to 
produce and those numbers are very small), such a weapon system is not good for a PBL 
contract, because the contractor feels difficulty in managing spare parts flexibly or 
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reusing the administration skills for such a system. A PBL contract is not good for highly 
reliable, limited-run weapon systems either, because normally, such weapon systems are 
very expensive with very high benefit and risk. The government should not take such a 
gamble. 

2. PBL Contract Level 

The higher the PBL contract level becomes, the more complicated the PBL 
contract becomes, which can cause the government more difficulties. The JMSDF will 
not have trouble understanding the mechanism of PBL in its pilot model, because that 
PBL contract is at the component level, which is not complicated. However, JMSDF is 
considering introducing PBL to the higher-level contracts; if that happens, the incentives 
and risks will become more complicated and JMSDF will feel the increased difficulties. 
For this reason, JMSDF should not raise contract levels until it has given careful thought 
to the complicated issues at each level of PBL contracts. 

G. ORGANIZATIONAL CAPABILITY (FUNCTIONAL CAPACITY AND 

COMMAND AND CONTROL) 

I. Government Should Have Policy for PBL 

Government should have a policy for PBL. This policy should include 1) the main 
reason to use PBL contracts (e.g., cost reduction, performance increase or risk sharing), 
2) the roles and responsibility of government and contractors, 3) replacement criteria, 4) 
maximum PBL contract levels for practical-use weapon systems and training weapon 
systems, and so on. If the government does not have a concrete policy for PBL, PBL 
contracts are more likely to be unsuitable. Contractors always have a concrete policy— 
maximize profit—so the government may be at a disadvantage if it has no policy for PBL. 
The government should review its policy based upon national security issues, budgetary 
concerns, the latest technologies, business trends, suppliers’ behaviors and their skills or 
knowledge about PBL, and must apply the policy to the PBL contracts. 
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2 . 


Government Should Establish Guidance and Training for PEL and 
EGA 


PEL contracts are complex and difficult to understand for military people, whose 
standard tours of duty (typically 2-3 years) makes it hard for them to study enough about 
PEL before moving on to other jobs. In fact, the officer who is responsible for PEL 
contract in JMSDF has not been able to conduct his own study about PEL by himself. In 
addition, PEL is a very flexible contract approach, so if the officer who takes charge of 
PEL contracts changes, the policy for PEL may be changed entirely. To combat this, the 
government should have a concrete and stable policy for PEL to maintain appropriate 
PEL contracts. It should establish PEL guidance and training so as to maintain the ability 
to manage and evaluate PEL contracts even if the people who are responsible for PEL 
contracts would be changed frequently. The government also should establish the basic 
framework of conditions and terms that should be defined in the contract, to ensure that 
its policy for PEL is spelled out in the contract language. 

For the same reasons, the government should establish EGA guidance that 
supports the officers who take charge of PEL contracts, in order to consider what should 
be included in the EGA and give them some incentive to update the EGA frequently. If 
the government outsources the EGA, it should have EGA guidance, so that EGA 
contractors can work appropriately. The U.S. government has issued many PEL guidance 
documents. Table 2 provides examples of PEL guidance documents for the person 
implementing PEL. 
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Table 2. Examples of PEL guidance documents for the person implementing PEL 


Service 

PEL guidance documents for the person implementins PBL 

DoD 

Department of Defense. (2005, March). Performance based 
logistics: A program manager’s product support guide. 

Defense Contract Management Agency, (n.d.). Performance 
based logistics (PBL) support guidebook. 

Department of Defense. (2003, November). Business case 
development guide. 

Army 

Department of the Army. (2005, August 18). Performance-based 
logistics (PBL) business case analysis (BCA) policy. 

Deputy Assistant Secretary of the Army. (2004, May 4). U.S. 
Army implementation guide performance-based logistics 
(PBL). 

Navy 

Department of the Navy. (2003, January 27). Department of the 
Navy (DoN) performance based logistics (PBL) guidance 
document. 

Naval Inventory Control Point, (n.d.). Maritime PEL deskguide. 

Department of the Navy. (2007, November 6). Department of the 
Navy guide for developing performance based logistics 
business case analyses (P07-006). 

Department of the Navy. (2003, June). Operational availability 
handbook. 

Air Lorce 

Secretary of the Air Lorce. (2004, November 10). Integrated 
product support planning and assessment. 

Marin Corps 

Department of the Navy. (n.d.). United States Marine Corps 
performance based logistics (PBL) guidebook. 


3. Government Should Keep Marginal Administration and Technical 
Skills 

The government can make its logistics and maintenance sections smaller, but it 
should keep the marginal administration and technical skills so that it will not lose the 
ability to implement and evaluate PEL contracts. This also helps cost savings, because 
contractors feel that government can replace a PEL contract relatively easily if it 
maintains its relevant skilled personnel. 
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IV. CONCLUSIONS 


A. PBL IS NOT A VERY STRAIGHTFORWARD SYSTEM 

The U.S. Department of Defense has stated that PBL is the preferred sustainment 
model for weapon systems. How long the U.S. will continue to pursue PBL as a 
sustainment model is unknown especially given the mixed results of cost and 
performance found in the literature. The JMSDF is shifting from traditional contracts to 
PBL contracts it should not forget that PBL is a complicated contract system because of 
the many variables involved compared to traditional contracts. PBL contracts include not 
only visible goods or service, but also invisible services such as risk sharing; those 
invisible services make it more difficult to grasp PBL contracts. Therefore, many studies 
could not find cost reduction or a relationship between monetary incentives and 
performance. Though it is difficult to understand and analyze PBL, the government 
cannot maintain optimal PBL contracts without tracking appropriate data and analysis. 

B. SEVEN IMPORTANT PREPARATIONS OR CONSIDERATIONS 

The government should consider seven important issues: cost, performance, 
performance metrics, risk, information systems, weapon systems and organizational 
capability. 

I. Cost 

For the cost reduction, cost data management is vital for government. The 
government should collect appropriate cost data and track them continuously and 
regularly. It is better for the government to have the ability to evaluate PBL contracts by 
itself, because contractors or third party evaluators may not evaluate PBL appropriately. 
And the government should maintain marginal administration and technical skills to keep 
the PBL contract price lower and to maintain the ability to evaluate PBL contracts. On 
the other hand, monetary incentives are useful to reduce cost, but the government should 
track cost data and determine the relationship between monetary incentives and 
performance so that it pays reasonable monetary incentives. 
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The government has to understand risk premium, which is not to be considered as 
simple profit for contractors. It is also important for the government to consider matters 
from the viewpoint of the entire life cycle, because PBL contracts’ terms are normally 
shorter than life cycles of most weapon systems, and it is important for the government to 
have some plan, not only for single PBL contracts, but also for all the PBL contracts that 
will be made over the life cycle of a particular weapon system. 

2. Performance 

Performance measurement is important for PBL contracts because performance is 
deliverable under PBL contracts. However, it is difficult to measure performance, so 
government should collect appropriate performance data. BCA is necessary to evaluate 
PBL, but BCA does not require a particular method, so government has to consider what 
considerations it will include in the BCA. Also, the government should implement BCA 
not only for peacetime but also for wartime scenarios. 

3. Performance Metrics 

The most important thing to get correct with PBL is appropriate and effective 
metrics to measure performance; those metrics should be reviewed regularly. If the 
government decides to change some metrics, it may have to change the PBL contract, and 
sometimes that costs money. Therefore, the government should make efforts to reduce 
the number of changes; standardized steps to choose metrics may help government to 
reduce that number. 

4. Risk 

One of the features of PBL is risk sharing, so the government will be released 
from inventory risk or transportation risk to a certain extent. On the other hand, there are 
some risks caused by PBL such as dispute solutions between government and contractors, 
organizational skills drain, data sharing and wartime operations. The government should 
recognize those risks so that it will not fail in PBL. 
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5. Information Systems 

Information systems are significant for PBL because they help to reduce 
turnaround time, which in turn helps both contractors and the government to reduce costs. 
Information systems also help the government to evaluate PBL. 

6. Weapon Systems 

PBL is not a solution for all occasions, so the government should consider for 
which elements it should implement PBL contracts. Generally, high-technology weapon 
systems or components are good candidates for PBL, but low-production special weapon 
systems or highly reliable weapon systems are not suitable for PBL. The government also 
should consider PBL contract levels and understand the differences between each level. 

7. Organization Capability 

The government should have a concrete policy for PBL, because if the 
government does not have a policy, it may make an inappropriate PBL contract. To 
reflect those policies in all PBL contracts, the government should establish guidance and 
training for PBL and BCA. The U.S. government has issued extensive guidance about 
PBL and BCA. It is also important for the government to keep marginal administration 
and technical skills to keep the contract price lower and keep its abilities to evaluate PBL. 
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V. 


RECOMMENDATIONS 


PBL is just starting in JMSDF, so there is much work to do, but the human 
resources remain limited. The JMSDF should solve problems and increase ability 
incrementally. Thus, we classified our recommendations as short-term recommendations 
for up to 5 years into the future, intermediate recommendations for 5 years to 10 years 
into the future, and long-term recommendations stretching over 10 years into the future. 

A. SHORT-TERM RECOMMENDATIONS 

1. JMSDF Should Understand the Intricacy of PBL 

The most significant issue for JMSDF is to understand clearly about complicated 
PBL mechanisms, which are gradually more complicated as the contract level goes up. 
Cost restraint, performance improvement and risk sharing are interrelated, so JMSDF 
should understand PBL in a general sense. In high contract levels, JMSDF may not be 
able to see evidence of direct cost reduction, but there are some possibilities to identify 
cost reduction if JMSDF understands the mechanisms of PBL and can consider it from a 
wider viewpoint. By understanding PBL, JMSDF will be able to exploit PBL more 
efficiently, and it will be easier to convince taxpayers of its benefits. 

2. JMSDF Should Have Policy for PBL 

On the basis of deep insight about PBL, JMSDF should have develop a concrete 
policy for its use. Though PBL has a variety of expected effects such as cost reduction, 
performance increase, risk sharing and so on, JMSDF should prioritize these effects so as 
not to deviate form the purpose of PBL. 

3. JMSDF Should Have Long-Term Plan for PBL 

After making a concrete PBL policy, JMSDF should make a long-term plan, 

because PBL requires significant efforts to begin, and even greater efforts to replace once 

implemented. First, JMSDF should begin studying PBL without contractors or third 

parties. Even if imperfect, such work should still contribute significantly to implementing 

PBL, using third parties and negotiating with contractors. Second, though it is natural to 
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focus on the rewards of a new program, JMSDF should recognize the risks caused by 
PEL such as chain of command risks, organization skill drain, data sharing risks, etc. To 
avoid or mitigate those risks, JMSDF should evaluate PEL over life cycle time, and 
should generate and maintain at least marginal administration and technical skills. 

B. MIDDLE-TERM RECOMMENDATIONS 

1. JMSDF Should Establish Criteria to Decide Whether PBL Should Be 
Used or Not 

JMSDF is planning to spread PBL contracts to entire weapon systems, but they 
should recognize that PBL is not a perfect fit for all systems. Some weapon systems fit 
PBL very well; on the other hand, some weapon systems do not fit PBL. So it is 
important for JMSDF to define precise criteria to decide whether PBL should be used for 
a particular weapon system. 

2. JMSDF Should Consider Exploiting Monetary Incentives 

Incentives are argued to make cost reduction and performance improvement go 
together, though they are incompatible under traditional contract approaches. It is 
difficult for JMSDF to exploit monetary incentives because of the national law 
constraints, but to improve PBL, JMSDF should consider ways to exploit monetary 
incentives. 


3. JMSDF Should Have the Ability to Evaluate PBL by Itself 

As we mentioned, JMSDF should have ability to evaluate PBL by itself. To do so, 
JMSDF should increase the number of personnel who are responsible for PBL, because 
as the number of PBL contracts increases, it becomes impossible to evaluate all these 
contracts with only a few personnel. To increase the number of personnel proficient in 
PBL, JMSDF should make PBL and BCA guidance and training programs; then, the 
personnel who are responsible for PBL will have similar significant knowledge about 
PBL and will completely understand the JMSDF policy for PBL. For PBL contracts for 
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aviation, not only MMC but also 3rd Maritime Service School should study and develop 
PBL and BCA guidance and training programs, and embed PBL training in officers’ 
education in 3rd Maritime Service School. 

4. JMSDF Should Conduct Appropriate BCA Before and After PBL 
Implementation 

BCA should be conducted after a PBL contract starts, but BCA also should be 
appropriately conducted before a PBL contract starts so that JMSDF can grasp the current 
situation under traditional contracts. This initial BCA will help JMSDF to consider PBL 
replacement criteria. 

5. JMSDF Should Improve Information Systems for PBL 

JMSDF should improve information systems for PBL to evaluate and improve 
PBL contracts. They should correct appropriate cost and performance data for efficient 
PBL contracts, and they should specify the data treatment in the contract papers. 

6. JMSDF Should Send Officers to the United States Naval Postgraduate 
School 

Though the officers of JMSDF must be able to understand PBL and conduct PBL 
appropriately by themselves, it is important for the officers to understand a variety of 
economic concepts, such as supply chain management, microeconomics and organization 
behavior to completely understand PBL. There are just a few universities that offer MBA 
courses in Japan, and the National Defense Academy does not have an MBA course 
despite offering a doctoral program. So, it would be beneficial for JMSDF to send 
officers to the United States Naval Postgraduate School to make them study the economy 
and business principles from both the general and military viewpoints. 
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C. LONG-TERM RECOMMENDATIONS 

1. National Defense Academy Should Have a Business and 
Administration School 

Though we can study in many American or Japanese universities or colleges 
about the economy generally, Japan has a very unique economic culture and JMSDF also 
has a special culture, so to create a Japanese-specific understanding of PBL, the National 
Defense Academy should have a Business and Administration School, which is good not 
only for PBL but also for the entire logistics needs of the Japanese military services. That 
school also can reinforce human resources for logistics in the Japan Self Defense Force. 
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